Skip to content

feat: 8 missing eval datasets, sources for 12 external skills, 100% skillmgr coverage#361

Merged
Delqhi merged 1 commit into
mainfrom
fix/eval-datasets-and-sources
Jun 17, 2026
Merged

feat: 8 missing eval datasets, sources for 12 external skills, 100% skillmgr coverage#361
Delqhi merged 1 commit into
mainfrom
fix/eval-datasets-and-sources

Conversation

@Delqhi

@Delqhi Delqhi commented Jun 17, 2026

Copy link
Copy Markdown
Collaborator

Completes the SOTA skill infrastructure.

Changes

8 new eval datasets (all 11 categories now covered)

  • skill-browser, skill-design, skill-ecosystem, skill-infrastructure, skill-memory, skill-planning, skill-process, skill-shop
  • 16 new test cases total, all four-arm comparator compatible
  • evals/README.md updated with 8 new catalog rows

12 external skills: sources: field added

  • All lifecycle: external skills now document their origin in metadata.sources
  • Includes browser-tools, codocs, docs, mcp-builder, design-frontend, ecosystem-context/marketplace, honcho/honcho-rollback/infisical, grill, scheduler

skill-code-graph cleanup

  • 4 .gitkeep files removed (real .md files now exist in all dirs)

skillmgr 100% coverage

  • Added test for empty/whitespace skill name edge case in MergeRequiredTools
  • Coverage: 99% → 100%

Test results

  • Validator: 37/37 skills pass --strict, 0 failed
  • skillmgr: 100.0% coverage, -race -count=1 pass
  • go build ./cmd/sin-code/internal/... — PASS

…killmgr coverage

- 8 new eval datasets: skill-browser, skill-design, skill-ecosystem,
  skill-infrastructure, skill-memory, skill-planning, skill-process,
  skill-shop (11 total now, all categories covered)
- evals/README.md: 8 new rows in catalog table
- 12 external skills: sources: field added to metadata frontmatter
- skill-code-graph: 4 .gitkeep files removed (real .md files exist now)
- skillmgr test coverage: 99% → 100% (added test for empty/whitespace
  skill name edge case in MergeRequiredTools)
- Validator: 37/37 skills pass --strict, 0 failed
@vercel

vercel Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
sin-code Ready Ready Preview, Comment, Open in v0 Jun 17, 2026 11:12pm

@Delqhi
Delqhi merged commit 870d942 into main Jun 17, 2026
11 of 14 checks passed
@github-actions

Copy link
Copy Markdown

🏆 CEO Audit — A+ (100.0/100)

Metric Value
Grade A+
Score 100.0/100
Critical findings 0
High findings 0
Profile QUICK
Min grade gate B

📥 Download full report (Markdown)
📊 Download SARIF (for Code Scanning)

Run ~/.config/opencode/skills/ceo-audit/scripts/audit.sh . --profile=QUICK locally to reproduce.

@github-actions

Copy link
Copy Markdown

🏆 CEO Audit — A+ (100.0/100)

Metric Value
Grade A+
Score 100.0/100
Critical findings 0
High findings 0
Medium findings 0
Profile QUICK
Min grade gate B

📥 Download full report (Markdown)

Run ID: 27725691929 · Commit: ${github.sha}

Run ~/.config/opencode/skills/ceo-audit/scripts/audit.sh . --profile=QUICK locally to reproduce.


// ScanFile reads a single file and returns all markers found.
func (d *AutoDiscover) ScanFile(path string) ([]TodoMarker, error) {
f, err := os.Open(path)
var b []byte
for _, f := range v {
bits := math.Float32bits(f)
b = append(b, byte(bits), byte(bits>>8), byte(bits>>16), byte(bits>>24))
var b []byte
for _, f := range v {
bits := math.Float32bits(f)
b = append(b, byte(bits), byte(bits>>8), byte(bits>>16), byte(bits>>24))
var b []byte
for _, f := range v {
bits := math.Float32bits(f)
b = append(b, byte(bits), byte(bits>>8), byte(bits>>16), byte(bits>>24))
return fmt.Errorf("instinct: demote update: %w", err)
}
} else {
if _, err := tx.ExecContext(ctx, `UPDATE instincts SET confidence = `+newConf+` WHERE id = ?`, id); err != nil {
type gitCmdRunner struct{}

func (gitCmdRunner) worktreeAdd(root, branch, path string) (string, error) {
cmd := exec.Command("git", "worktree", "add", "-b", branch, path, "HEAD")
m.mu.Unlock()
return errors.New("agentteams: already locked")
}
f, err := os.OpenFile(m.path, os.O_CREATE|os.O_RDWR, 0o644)
return time.Time{}
}
var t time.Time
json.Unmarshal(v, &t)
var obj map[string]json.RawMessage
if json.Unmarshal(v, &obj) == nil {
if text, ok := obj["text"]; ok {
json.Unmarshal(text, &s)
m.mu.Lock()
m.lockFile = nil
m.mu.Unlock()
f.Close()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants